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Field of -blie Invention 

This invention concerns? an arrangRmRnt-. and a method 
for controlling an electzronic device starting from imagco 
of a base. The invention also coixcems an input unit fox 
inpuctlng Images from a base. 
Background of the Invention 

The Applicant 'a Patent Publication No, WO9fi/20446 
discloses a reading pen which can be used for recording 
text by imaging this from a base. The reading pen has an 
optical sensor wiixch. records a number of images, wiuh 
parcially overlapping connencs, of ctxe cexi: which is to 
be recorded. In addition, the reading pen has a proce£S£3or 
which puts together the images/ identifies the text in 
t:he Images and stores ic in character- coded format. The 
tpxt can then be transferred to a computer with which the 
reading pen communicates. 

in addiclon, che Applicant's Patent Publication Wo, 
W09S/604^9 discloses an optical mouse which is arranged 
to poaition a cursor on a display of a computer. 

The readinq pen and the optical mouse are two exam- 
ples ot input", units whinh nan bp* xi.ged to input informa- 
tion into a computer and to control the function of a 
coaipuLfcii . AnoLlitsr ejs^ample of an input unit ±s a keyboard, 
which can be nsed both to R-nt^-r information and to con- 
trol the computer by means of various keyboard commando . 

A user does not want to have to change between dif- 
lerent input units in order to be able to carry out dif- 
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£ex-ent functions. Theielujie IL its cl yeneral recruirenienr 
niian each inpiin unir is t.n hR ;^b'l «= t-.o he i.isect tor ae many 
different functions ae pooeible and in ao flexible and 
simple way as possible; for Llie utstix . 

US Patent No. 5,932,864 di sr. I r)5=;RS 3T"raTigRTnent 
for accessing electronic inf oxmation via printed matter. 
More specifically-/ the arrangement coiiipi.iBfc!fci cui IxipuL 
unit which via a keypad is swirchable ber.we.ein a ^^namiR-r 
mode and a mouse modQ. In the scanner mode/ a Ufser can 
input an image of a dedlc;<d.Lfcid ubJeuL on Llx^ base/ more 
specifically a bar code, a character or a symbol. The 

image is tra.naf err-ed from the input unit to a computGX', 
which decodes the image and which, as a r-esult/ executes 
a preprogrammed command, for instance to obtain inter- 
active softwaare from an external database and executing 
this software on the computer. During e-?5.ee:LLLlon, tht; uaer 
can. by operating "rhe keypad, change Che input unit to 
the mouse mode in order to intezract with the software on 
a display. 

A problem of inputting rhis cype of dedicated 
objects is that the object mnst in many cases be accom- 
panied by some sort of explanatory text, so that the usex 
can understand which command Is initiated by the object:, 

Tn F^-pRninuB o-rder catalog-Lies this can nsnally be provid- 
ed, but in many other cacec the cpacc ia more restricted. 
Thex-efox"e the user utcty hcLvw Lu Ikciji'xj. to what each ob-ject 
relates, which however reduces the usability of the 
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airrangement: ±f it is to be geneidllzed LjeyuuU a certain 
application, such as programTnlng s tp.lRviHinn set. 

Sum.Tna.3rv of the iTiventioTi 

An object of tliis invention is to ctddlLioxidlly 
improve prior-art input unxts. More specitinal ly it tr 
an object to provide a general and flexible technique for 
controlling an electronic device. The pi*ovided Leclmiqae 
Should be intuitive to the user. 

This object is achieved by an anrangement according 
to claiin 1 and a method accordixxg Lu cleiiui 22 * Tlie depen- 
dent claims define preferred eiriboditnents , 

According to a first aspect, this invention concemc 
an arrangement for controlling an electronic device, said 
arrangement comprising an input unit with an optical sen- 
sor for recording images, and a signal -parocesaing unit 
for identifying predetermined iiiformation in au lecLtiL uiits 
of said images and for controlling the electronic device 
dependent -upon the predetermined information. The input 
unit ig arranged/ in a first function mode/ to convert 
at least one image to a current: text string containing a 
Kfaqijfa-nnf^ of characters, and the signal -processing unit ia 
arranged to control the electronic device on the basis of 
the <jurj.eiiL Lejcu EStrincj, 

According tn tb^ invention the arrangement for con- 
trolling an electronic device is based on an input unit 
function Imowii peir se^ thaL iti iecuxdiiiy o£ text/ which, 
however, Is modified by making the signal -processing unit 
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control the electx'onic device on Lliti bcitjiy u£ Lliti current 
next: string nliat: is ire^r.oTC^eiC^ . A t3.«=;rt nan thuB control the 
electronic device on the basis of text which ic read 
•using the input unit. This is a great ad-vantcicfe since Lhe 
command indication can be prlnT:ed or written in more or 
less clear text on a hase, whereby the control of tho 
electronic device takes place in a way that is tranepci- 
rent and incuirive to the user, iworeover, £3uch r.exr.-baRfiri 
command indications can be incorporated into a running 
text, without affecting the lay-out of the text. In uxder 
to facilitate the user's identification of commands, 
these may, however, be marked somehow, for instance by 
using a divergent font/ a diveargent color, underlining 
etc . 

The inputting of text into the inventive arrange- 
ment can advantageously be accomplished in the same way 
as in the Applicant's above-mentioned patent piiblication, 
although other accomplishments within the scope of prior 
art arc also feasible. The optical sensor can be a line 
sensor, but is advantageously an area sensor. 

The signa 1 -pTOCip.Rsii ng utti t is preferably accomplish- 
ed ac coftwarc* However/ it may consist of a specially 
adapted hardware uixuulL^ fur ijiaLance an ASIC, an FPGft 
etc, or a anitahlpi nnmbinati nn of hard software and hard- 
ware - 


5 


The elfciuLiuiilc device controlled by means of Che 

arrfartgRmR-nt-. nsn bft Pi coinputer, a mobile phione, a PDA, 

or a similar electr-onic device- 

The commai-id indication can coii. eta pond Lcj e± commcind 

to the electronic device at system or app 1 i rati nn iftviai. 

The command can be, for inctancc, to emulate a keyboard 

command. Alternatively, it cein clIho be a ypeclal command, 

for example a user-defined nommt^nd . 

Besides command indications in clear text, the clcc 

tronlc device ucui t&lau be cuxiLi-ulled by Le^L which is 
used in specific applications in the electronic device, 

such as addresses. The content of these addreccec varied, 
but the ai-irangement is suitably ari'anged to identify the 
format ot the current text string and, sstarting f-rnm 
this, interpret to what th© text string relates. By "for- 
mat" is meant the overall layout of the text sLiliiy, uuch 
as presence and location of one or more given characters 
or character combinations in a text string, 

The arrangement conveniently compriaes a format 
dar abase conraining predetermined formats, to which the 
inputted text string is matched to determine whether a 
command is to be eKecuted^ and in that case which one. 
The arrangement: advantaqeously also comprises a database 
editor which allows the user to introduce formats and 
aesociated command£3 into the format database. It ia par- 
ticularly pielfciJLXfcid fui- Ulieise commands to initiate execu- 
tion of software on the electronic device. Ot course. 


sucli tfiii edlLdtble dc4Lttba.se may also comprise a set of 
regriJlar t-.p.xt: snringR (comTnand indications) wh.ich are 
matctied in their entirety to the rcoordcd text and which 
are each associated with a command. 

The use of a format database means th;qh hhp a-rrange- 
ment/ which with the input unit in its first function 
mode is arranged to inpuL LejtL, catiipriyea an intellicfenx: 
filtier which incerprers nTie iTipi3ti-.eti tRxt in crder to 
identify commandfi therein. The filter ie intelligent to 
such an extent that it does noL neuti tstsdiily rs^quire iden- 
tical correspondence between the inputted text string anri 
a text string in said database in order to identify a 
command- The use of auch an intelligent filLex yivey 
several advantages. When necessary, the arrangement, with 
the input unit in one and the same function mode, can be 
used both to input text into the electronic device ctiid Lu 
conrrol the same. Moreover, the eleccronlc device can Joe 
controlled, using at least part of the current text 
string, as will be described in moire detail below, 

in a particularly preferred embodiment, the text 
£=;tTi -ng nnmpri ses an address , The format database thus 
comprises pr-edetermizied formats for different types of 
addresses / and the siqnal -processing unit is arranged to 
idRTiti-Py an address in the curarent text string and cause 
the electronic device to directly or indirectly connect 
to the address - 


7 


In a pax-ticu-lar-ly pt'ef erred embodiiueiiL , tUe siqnal- 
processlng unlc is arranged ro cause, when i raesnt-.i tying 
an address for electronic mail in tti© x-ecoarded text, the 
electronic device to open a program for electronic mail. 
Preferably, the arrangement: causes ciie device not only to 
open the program but also to open a template for electro 
nic mail . It is still more preferred that the template its 
opened with the recorded e-mail address entered in nhe 
aridr^ess field. It is also conceivabli© that the input unit 
is connected to the message field of the template/ so 
Lhat the input unit can be used to Input message text, 
tor instance by scanning of text or inputting of te^ct, 
if the input unit has such a function mode. 

The identification of an e-mail address format can 
take p.larift^ tn-r e=;x;3TTip1 r, by -rptrincj-ni t ion of the at sirjn 
(@) , the signal processing unit interpreting all charac- 
LfejLiD whlcjh arts ayyociaLed with the at siqn as part Of the 

Furthermore the oignal procccoing unit caxi advanta- 
geuutsly be arx-axiged Lo cause, when identifying a web 
address in the recorded text, the eslftrfrnnir. device to 
open a web browser. Preferably, the device is caused not 
only to open the browser, but dlau Lhe web paqe corre- 
sponding to the web address. The signal -p-rccessing \init ' s 
identification of a web address format can, for example, 
be based on recognition of the character combinatiuii 
"hLLp://" oi. "www", the signal-processinq unit Interpret- 
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ing all characters which, are associated with seiid chtirac- 
Ler combination as parr ot uhe web address, in nhis way, 
the user can easily and quicJcly open a web page by using 
the same input unit as he or she uses for other input 
functions , 

The signal -processing unit can also advantageously 
be arranged to cause, when identifying a phone number 
ill Lli^ i'ecjyx'ded Le^tL, the electronic device CO call Che 
phortR mimbpT. 

The arrangement according to the invention is easy 
Lo use for the user who need, only move the input unit 
over text or place it on text in or-der- to control the 
electronic device* The text can be self explanatory, 
which means that the arranqement will be intuitive to the 
user. Tine arrangement: is a 1 Pio gpine.ral Find flp.Tfible, in 
that the electronic device can be controlled on the basis 
uL Lhw roiutdL of an IxipuLLed LexL strincj, and by uainq" at 
lea£3t part: at the i-.«x1-. RtT-ing. 

The arrangement can also eacily be combined with 
othex- inpuL uiilL fuiiuLluiia which ci£*e baaed on recordinq 
of images by means of an optical sensor . 

In an advantageous embodiment, th.c arrangement also 
comprises an optical mouse function fux uuiiUiollixiy a 
cursor on a display of the electronic device. Th^ imft-r 
nan thF»n carry out mouse functions using the arrangement 
and also control the electronic device by recording text. 
The mouse function it* ddvdiiLayeuualy inUeqrated into the 
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liijjuL uxilL ciiid xKaliiied In Uie aciuie way as in the Appli- 
cann 'fl r^bnv^sl-T^p.T^^.in^^=»d pst-.Rnt-. pnh 1 1 oat.i on . OtJier realiza- 
tions within the scope of prior- aarb techniqxiG arc, how 
ever, also possible* 

As mentioned above, the signal -processing lanit". r.an 
generate a predetermined command when recognising one or 
more px-edetermined characters or words In Lli« iutjuiafcad 
rext. The prederermined words can simply be designar.i r)ni=5 
of the commands that are generated. To this end, the 
ai-rangement may advantageously comprise a pioduuL uii 
which a plurality of command indicanions are stated. The 
GOTtimand indications can advantageously be indicated by 
character corabinafcions which aire eaa.sy for the xzser to 

understand, ihe producu can be, for example, a mouse pad. 

In another advantageous embodiment, the arrangement 
comprises, alternatively ox- additionally, a handwriting/ 
handdrawing function for inpurcing of handwritten infor- 
mation into the electronic device. The handwriting/hand- 
drawing function is advantageously integrated into the 
input unit and realized in the same way as in the Appli- 
ra-nt'R VRt.^.-nt. Pnhl i oa t "i CD WO99/604e7. Other realizations 
within the scope of prior-art technique are, however, 
also possible. 

Tn one embodiment, the signal •processing unit is at 
lesLst partially located in the came cacing ac the clcc 
tronic device. As a result, the inpuL unlL <j<in be iiicLde 
simpler and cheaper. In addition, the processor capacity 
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which is already available In Lhe electronic device can 
be used ro carry ouc nlies fnnr.r.innp; ot the sirjnal -process - 
inrj unit- Certain proceseing of the recorded text can/ 
however, advantageously be carried uuL ixi Llie input: unlC, 
for example localization of the text in thp. iTnage or 
imarjes and conversion of the te^t to character coded 
format, for example ASCII code, so that <i auudllez* amount: 
ol inloarmation needs co be transmirned from thR -input 
unit to the electronic device. 

In another embodiment Lhe tilyiicLl-px'ocjeBsinq unic can 
be completely innegraced with rhe input unit so thpat thp 
electronic device receives on© or moare commandc directly 
from the input unit. In another embodiment the input uniL 
can "^usc record images and transfer these to the signa I - 
p-rnnRasi ng imit which carries out all the processing of 
the images , 

The input: unit: can be arranged t:o communicate with 
hhfa FilRntronic device by wireless means, so that the uce 
of the input unit id as flexible as possible and ao that 
uerLain luncciona can be used stand-alone, Alt:ernativeiy, 
commun.i ca t i on via Pi cable could be possible, for example 
via a USB. 

Accordliiy Lu une more embodiment, the input unit 
functions in the tirsh fianntion mode as a handheld text 
scanner and the signal -processing unit ±c arranged to 
continually interparet the text contenL of Llie irnacjes 
ifcitjorded by the oprical sensor. To prevent words whicJa 
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are only intended to be inpuLLed c=Liid y Lured In the elec- 
tronic device, but: whicli consij=i1-. of -hhe same ciaazracter 
coTnbination as a command indication^ from being inter 
preted as a command, it is possittle to place addlLiuiigil 
demands on wliai: che signal-processing unit is to intRT-- 
pret as commands. For instance, it may be rccjuircd that 
command indications consist of characters in fcipedL:lc±l 
rone, special size, printed in capiral lerrers, undR-r- 
lined, printed in e^ctra bold type or in ita.lias etc. 

Alternatively, the arrangement is deslyxifeid in auch 
manner chat it can selectively be caused to operate in 
a control function mode, in which th© signal-processing 
unit is arranged to control the electronic device on the 
basis of the current text string- The embodiment has the 
^advantage that it simplifies the arrangement since it 
j-ust has to interpret text in the control function mode. 
The risk that text which is only Intended to be inputted 
fl-nci RtoTed in the electronic device is erroneously inter- 
preted ao a command io also eliminated. 

An input unit with a plurality of function modes is 
in one emborii mftnt ar-ranged to automatically select the 
f^lnction mode on the basis of the content of one or more 
inaages, i.«. by ideiiLirylntj some kind of predetermined 
intormation. The pre.dp.tfiTrni -n^d information can in prin- 
ciple be any information which makes it possible for the 
input unit to interpret that it is to chaiaytj Tium a cur- 
rent function mode to a new function mode- The informa- 
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tion can, for example, consist of oxie ox aiure predener- 
mined characcers, symbols, words, ^-ev^. in speciai tont 
or line thickness or the like. When the input iinit idcn 
tifics the p ire determined inf oarmation, it autoaiaLiudlly 
chanqes zo ztxe required funccion mode. In tJiiia way th« 
i.iser does not need to press any buttons. 

In a preferred embodiment, the predetermined infux- 
uuiLioii Its a predetermined paccern. If the inpur un.in, foT- 
*:»v;qTnple, has a mouse function mode and a control function 
mode, it can be programmed to be able to ideauLify Lht» 
paLUex-ix on a mouse pad. when che user places che input 
unit nn the mouse pad, it records an image of the pattern 
on the mouoc pad. The input unit identifies the pattern 
as predetermined informacion which indica-ces mouse func- 
tion and it rhang«.<=i sntomat ically to mouse function mode 
and procooaca the itnagca to achieve the mouse function. 

It is, of t;uuxt5fci, uuiiveaieiiL if che input; unlu Is 
also arranged tn rrhrangR f-rnm the mouse fimction mode to 
the control function mode when it detects other predeter- 
mined IxiroxiticiLlyxi, If Lhe input: unit: Jias only a mouse 
function mode and a controi tunrti nn mndPi, It can, for 
example, change back from the mouoc fimction mode to the 
control function mode when it deLecLa LhctL Lhe predeter- 
mined pattern for the mouse function mod« i j=? no longer 
pTaRf=»nt in the captured images. Alternatively, the change 
can be carried out on the basis of positive identifica- 
tion of d tjfcixLalii piece of predetermined information. 
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This automatic change beLwe^ii diirerent; function 
itiudea can, of course, be used 1 nrte^pFinrient ly of how many 
snd which fxinGtion modes the input unit comp^isca. As 
mGntioncd above, the input unit may, fox ajteiiiiple ^ com- 
prise a control fimctiion mode, a text inputting mode 
(scanner function mode) , a mouse function mode and a 
handwriting recording mode. 

The input unit may also comprise a phorngr-sphi ng 
mndfi^ in which it can be caused, lilcQ a, camera, to record 
and store single images . 

lu an advancaqeouB embodiment, tiie predetermined 
XT) •forma ti on consists of a position-coding pattern/ pre- 
ferably an abaolute position- coding pattern. 

The advancaqe of a position- coding pattern is that 
the predetermined information can conaist of one or more 
specific pooitions , This makea it easier fox- the device 
to identify whtsxi iL la Lo chanqe, as It does not need to 
carry out any chars nt^r recognition (OCR) . 

Absolut© poeition-coding patterns are known/ for 
e^cample, Ijloiu us 5,852,434 and the Applicant's i'atent 
Publication WO00/739a3 which w;3K not p^^blicly available 
at the time of the filing the Swedish patent application 
from which the preseiit appliudLioxi claims priority. 

According to a second asspent, thF% present invention 
relratfiR to e method for concrolling an electronic dcvicC/ 
comprising the steps of opex-ating a handlield input unit 
to recuid dL least one imaqe, identllying predetermined 
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inf oarmation in said at least one iiiictge, isiiid uoxiLx'ollinq 
Lhe electronic device dependent: upon said pT-Rcietermln- 

i -n format ion. In tiiis method, said at lea£3t one image 
ic converted to a current text string which, compi-ises 
a. sequence of characters, and the electronic device is 
nnnl-.-ro J led on the basis of the current text string. 

The advantages of this method are evident from Lhe 
abuve aifcfcjuaalon of the arrangement. The features of rhft 
airirang^jup^-nt. a-rf?^ where appropriate, applicable also to 
the method - 

Thfci AppllucLxiL's PciLent Publication WO99/60468 dis- 
cHosieR an inpiit nnit wb.ich has an imarje-based mouse func- 
tion mode and an image baaed input fianction mode. The 
input unit is chanqed by the user pressing buttons- 

A further object is to gene-rally simplify the use 
of an input unit which hao two function modes, so that 
the change between different £anuLloxi modes can be car- 
ried out in a way that i £=s smnntb foT the user. This object 
is achieved by an input unit according to claim 20. The 
dependent claims define pxelerred eTribodiments » 

More specifically/ the invention compTi sspjs anno-rding 
to a third aspect an input unit which hao at least a first 
and a aecond function mode. The input unit uouipi'ltses a 
detector for capturing of images, tor inshanr.fi an optical 
sensor, anri an image processing- device, for instance a 
proceecor, for processing the images to achieve said two 
function modes. The liipuL unit ly arranged to change from 
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the first to the second functitjii iiiyde when "Che Image pro- 
ueayor dereccs a first: piece nf pTRrif^^termined information 
in one of said images- 

Lilcc in th<3 arrangement for cQutrcilliiiH c±ii eleccronlc 
device/ Che predecermined information can In p-rinciple be 
rjny i -ntormation which makes it possible for the input imit 
to interpret that it is to change from a cjurx-exit fnnccion 
mode Lu d iifc-w luncrion mode. The informar.inn n^n, tor 
example, nnriRist of on© or more predetermined characters, 
cymbolo, words, text in special fon.t or liiiti thickness or 
the like. When the input: unlc identifies Che predetermin- 
ed infOTmati on, it automatically changes to the required 
function mode. In this way, the user doee not need Lu 
pifcitafcj any buttons. 

In a preterreri Rmhodiment^ the predetermined infor- 
mation ic a predetermined pattern. If the input xaiiL, JTox" 
example, has a tiiuuue function mode and anocher function 
mode^ it can be prog-r^smniRd to be able to identity the pat- 
tern on a mouse pad. When the user place© the input unit 
on the mouse p<sid, the deteccor records an image of the 
patcern on Che mouse pad. The» im;=}QQ^ processor identifies 
the pattern as predetermined information which indicates 
mouse function and it then chaxiyeti ciuLomacically to che 
mouse funccion mode and procesf5ei=i th^ images to achieve 
the moiinesi fxmction. 

of course, it is convenient for Lhw input unic also 
to be arranycd to change from che second funccion mode to 


the first function mode when it detacLy a second piece of 
prtsdetermined Information, if r.lie input unit just has a 
Tnm.ise function mode and an input function modC/ it can, 
for example/ change back from the moiise function mode Lo 
the inpur funcclon mode when che image processor d«=!tRn-hpi 
that the predQtermined pattern for the mouee function mode 
io no longer present in the recorded images- AlLex*iiciUive- 
ly, the change can rake place on rhe basis? of poRitive 
i fiRnti float ion of another predetermined pattern. 

In an advantageous embodiment, the: prede Lex mined 
liifux-EUciLlon consiscB of a poslcion-coding paccern, pre- 
ffi-Tribly an absolute position-coding pattern. The advan- 
tage of thio is evident from the above discussion of the 
arranqemenc for controlling an electronic device. 

The fimntinnR between which the change takes place 
can, for example, be a mouse f\mction mode, a scanner 
fuiicLloxi luude, c4 handwritinq recording mode, a photo- 
graphing mof^*a or some similar f-unotion mode which can 
be achieved on the baaia of captured images- 
Bxlfcal Deacjrlublon of the Dra wings 

This invention wi ! I now bR described in greater 
detail by meanc of an embodiment with reference to the 
accompanying drawings, in wliich 

Fig. 1 schematically il1iiRl-.-rRt-.es the composition and 
use of an arrangement accordingr to the invention, a.nd 
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Fig. 2 ic a aimplificd flow chart showing opexcLLiuxis 
which aore: carried ouL ixi an arrangemem: similar no r.hft 
one in Fig. 1 . 

Degcr-i-p-bioxi of a Prefcyycd Embodimeiifc 

All eaLbodlmexiL ol an arrangemenc is described below 
whicti compri a inmi.ge tunofcion mode, a igcanner' or- read- 

ing pen function mode and a control function mode which 
is based on text recordiiiM . 

Fig. 1 aJiows a moi3fle. pad ion, an eleotr-onic device 
20 0 in the form of a computer- einci an input unit 3 00 for 
the computer , 

The mouse pad inn ha^ a wnrlcing tieid. 110 with an 
irregular pattern (not shown) which malcca it possible to 
determine the relaulve poal Lions of two images Which have 
parcially overlapping contents by me.nnfi nf the contents 
of th© images, and a command field 120 > in which a number* 
of predetermined coramazid indicaLiuiiu atated. 

The input unit 300 has a causing 1 in the shape of 
a pen. One short side of the casing 1 haa o. window 2 
through which images are ccLpLui«;id Tor the different: 
imaqe-based function modes of the xnput unit :^nn- 

The casing 1 contains principally an optics part, 
an electronics part and a power- supply - 

The Optics pare comprises a number nf lighl- emitting 
diodes 6, a 1 e.ns Kyf=it-.F^Tn 7 and an optical sensor- 8 which 
conatitutec the interface with the electronics part. Tlie 
light emitting diodes 6 axts iiiLeiided to illuminate a sur- 

1 8 


face u£ tUe base wnicti is at ntie moment below thft wn'-nr^ow. 
Tlie lRr»R py.gtem 7 is intended to pzroject an image of the 
suK-face which, io below the window 2 onto the liyliU-st?xisi- 
tive sensor 8 in c±» correct: a way as possible. The npti - 
cal sensor 8 can ronsi nt of an area sensor, such as a 
CMOS sencor or a CCD sensor with a built- ixi A/D ti"^ulH- 
ducer. Such afejiiaux-a are commercially available, 

m r.hi?! Hxaniple, the power supply for the input unit 
is obtained from a battery 12 but can alternatively be 
obtaiiied Lisuiii iA uwaxxis connection (noi: shown) . 

The electronics part compri^fts p-rocessor 2 0 with 
conventional associated circuitQ, auch aa various types 
of memory, and associated piuyxcims lor carrying out the 
functions described here. The e^l Fictronics part also com- 
prises a transceiver 2 6 for trancmitting information to/ 
from the compute^- 200. The Lxcinyuel ver 26 can be based on 
Infrared technology, ultrasonics or radio he=;r:hnnl ogy for 
transmission over short distancees, for example in accor- 
dance with the Bluetooth standard. The eleutroiiics part 
further comprises buttons 21, by means at which the user 
can control the input unit 300 and in particular chcxnge 
the input unit between the mouse f uiicUluu. mode/ the scan- 
iitdi fu^icLion mode and the control function mode. When thp 
input unit 300 operates in the mouse fxznction mode, the 
buttons 27 can alco have functions which correspond to 
the click buLLoxia a traditional mouse. 
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Tlifci tjuuipuLer 2 00 is an ordinary personal computer 
wirh m'rr.nir.R and programs which make possible commimi 
cation with the input -orLit 3 00- However*, in this embodi- 
ment this alao contains a iaiMiial -processing unli: which 
conscltutes part ot the arrsng«Tnent for controlling its 
function. Tho oignal processing -unit consists in this 
example of a piuyiditi which is installed in the compucer 
200, This is shown symbol i i ly hy broken lines and refe- 
rence numeral 210. 

As mentioned; the iiipuL unit 3 00 has a scanner func- 
tion mode, a mouse flinction mode and a rrnnhrnl function 
mode . 

The scanner function mode is ua^d Lo record text - 
The user passes the input unit 3 00 across thn tRvt which 
he^ wR-nts to record- The optical sensor S records imagaa 
with partially overlapping contents. The lititiyea cire put 
toqether by Che processor 20. li'ach character in the put- 
together imacye is localized and, using for example neural 
network soffcwcire in the processor 20, its correispoiidliiy 
ASCII characters are determined. The text converted In 
this way to charartft-r-noriRd format can be stored, in th© 
form of a text otring^ in the input unit 3 00 or transfex- 
red to the cuuipuLer 200, The scanner function is describ- 
ed m greater dp.tsil in the Applicant's Patent Publi- 
cation No, WO98/20446, which ie incorporated herein by 
reference . 
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Tlice luuujse lunccion mode ±s used to control a cursor 
on r.hfi rii.spl;gy 7.01 ot the computer 200. The mouse func- 
tion mode ic alco image based in this embodiment. When 
the input luilL 300 ia moved across the working field 110, 
the op1-.ir.f5l RR-npin-r R -records a plurality of images with 
partially overlapping images. The processor- 20 deteirniines 
positioniiiy alyiicila lor the cursor of rhe computer 200 on 
rhe hiasis of r.he: relf^t.-ivP! poFii ti n-ns ot the recox-ded 
images, which are determined by mcancj of the contents of 
Lht; liuciyfciB- The mouse function Is descrilDed in greacer 
detail in the Applicant » P;!3hp.nt Piibl i ri?3t.i on No. 
V7O99/60469, which ic incoarpoDratcd herein by ref earence , , 

The control function mode 1b hatiuil uxi the tsccanner 
function. The user records text in the. Ramt^ way as in the 
scanner function mode. The text ic cent in character 
coded format fiuui the liipuL uiilL's 300 transceiver 26 to 
rhe signal -processing unit 210 in the compntftr Pnn, toge- 
ther with an indication that thic ic control information 
which is to be interpreted. The signal -proutsaaliiy unit 
210 examines Che received text and aearcJnes tor- pT-Rdeter- 
mined infoarmation in this in the forrn of predeter-mined 
characters and character combinaLiunti . When fcsuch pre- 
determined Information is found, rhe signal -procef?sing 
nnit 210 creates predetermined commands to the coirrputcr 
200 as a function of the pircdetcrmincd information. 

The ax j.ciiiyeuifc5iiL deiici-ibed above is used In the fol- 
lowing way. ir'irsi: assume that the user want.q to use the 
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input uLilL 3 00 ciy ci mouse- He selects Che mouse function 
mode by mft?3ni=? of f.hp buttons 27. By moving the input unit 
2 00 on the working field 110 he controls the cursor on 
the display 201 of Lhti euuipuLer 200- Assume next that the 
user edits a document in hhp. nomputeTr 200. He can then 
mark text by "clicking" with the buttons 27 and posi- 
tioning the cursor- Assume Lh^L the u«er first wants to 
replace a first piece of r.e.xt with « Beconci piece of text 
which is situated elsewhere in the text. The uocr presses 
one of the buLLoni= 27 cind ptiyaett the input unit 300 
across the second piece ot text to mark the s=!;gmR. Thp^n he 
changes the input unit 300 to the control function mode 
and records the command indication "cut" by priauiny the 
input unit 3UU across this command indication on ^Hr com- 
mand field 120 of the mouse pad 100. The input unit 300 
then sends the character-coded Lej^L '*cuL" Lo the siqnal- 
processing unit 210 in the computer 2UU, which identi t i 
the text as a command indication and cireatee a corrc- 
cponding command fonr the wor-d processing application ooxi- 
cerned, which cuts out the mar3ced piece of text. The tifie-r 
next r.hrsngRR the input unit 300 to the mouse function 
mode and marks the first piece of text using the Input 
oiiit 300 bind then causes the computer 300 to paste the 
cut-out pi{»o«= of r.f^yrt in place of the marked text by 
ohanging the input unit 3 00 to the contr-ol function mode 
and rccox-ding the command indiuctLlun "paste" usinq the 
input unit 30 0, 
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Now assume that Lliti uyex' wcixits to enter cext from a 
newspaper in "his rtor-umpinl-. . He tirst positions the cursor 
in the required place uoing the input unit 3 00 changed to 
the mouse f miction mode. Then h^^; chanyes the input unit 
3UU CO "Ctie scanner tunction mode nnri nnf^-ns the text from 
the newspaper. The text ic converted into character-coded 
format and tx-anemitted to the sicjucLl -piocfcissinc^ unit: 2X0 
which causes rhe compur.er :^.C3 0 to iriRe-rt the text in the 
position marked by the cursor - 

Now assume that Lhe uBttX" yees an interesrlng web 
address in Lhe newspaper he is reading and wants tn InnV 
at this web page* H© then changes the input imit 300 to 
control function mode and i-eads off the wt^b riddrests from 
Tihe newspaper. The recorded text 3 5? transf Rr-rftti to the 
signal -processing unit 210 which identifieo the character 
combination "http;//" and causes Lhti coiupuLer 200 co opera 
the web page wlrh che recorded address . 

Finally, a.ssume that the user wants to send an 
G-mail to a friend, lie uses the input unit 3 00 chaxiyed 
to rhe control function mode to record tJae commanri indi- 
cation '*P!-mpil" on the mouse pad 100. The recognition o£ 
thia command indication by the signal -px-ocesslny uiilL 210 
resulLa In Lhe unit qeneratlng a command to the computer 
200 whi nh ohiirrs it to open the e-mail program. The user 
can then record the required e-mail address and even the 
content of the messaye ualiiy the scanner function - 
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Ar Khown above, the user can conveniently carry out 
a number of different functions which compr-ice inputting 
inloriiiciLiuxi cind ccjuLrulllny Llie uumjjutej: 2 00 by uiecnits uf 
jiiRt". nr]^. input nnit 'AOD . 

Of course, other functions can b© intecfra-fced into 
Llifcj iiipuL unit 3 00 in order to further increase its 
usaJoiiity. An example is a fimcrion to record handwritten 
te:x.t, which ic deccribed in the Applicant's Patent Publi- 
cation No. WO99/6 04 67/ which is incox-porated herein by 
reterence . 

Another example is a photographing mode, in which 
the input unit 3 00 via the buttons 27 can be caused to 
record single imag-es and score rhese and/or transfer 
these to the computer 200. The lens system must be chang- 
ed so that a sharp image on the sensor 8 is obtained at 
an infinire distance, or normally a distance of about two 
meters. In the scanner function mode and the mouse func- 
tion mode, however, the lens system 7 is adjusted so that 
a sharp linage is obtained ot an object which is position- 
ed at the window 2, i.e. normally about two centimeters 
from the senaor D . 

Moreover, other commands than those stated above can 
be generated. A npie-r m;^y alsn himj=;Rlf fiRfin*= how recorded 
tc3ct io to be interpreted by the signal pirocessing unit 
200 arid which conLiOl of the cuuipuLcx 2 00 cl uej-LeLiii 
recorded text is to result in. 
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rr. ha.ci haen descrilDed above cliar rhe change becween 
the different f -unction modec takes place by the -user- 
pi-eatiiiiy Llie buttoiT-S 27 on the input unit 300* As an 
alrernanive, rhe input: unit 3 00 can irself detect that 
it is to change between different f\.inction modes. 

Fiy. 2 illusti-atee achematically a flow chart of the 
operations in sucla an alcemarive arrangemenx: , The input 

unit 3 00 is a-rranged bo search for* pr-edete^rmined infor- 
mation in each image recorded with the optical acnoor S 
(seep 4UJL) . The predetermined Information can be, for 
example, the pattern on the worlcing fip.ld 110 of hhi=i 
mouse pad 100. If the processor 20 detects this pattern, 
it Changes co the mouse function mode (step 4 02) and pro- 
cesses the images in the manner describer^ ;^bovfa. t.n gp.npa- 
rate positioning oignalo to the curcor on the diEsplay 201 
of the computer 200. If the uaer Lhexi placey the ixipuL 
uTiih ."^no on ne=!W5?paper in order to scan text, the pro- 
cessor 20 no longer dctcctc the tuoudc pad pattern and 
then knows LhaL IL 1h Lu chaiiye Lu Lhe seamier function 
TTioriFi (Rt-.Rp 40:^) rsnri prnceflfl the images in the manner 
described above for identification o£ text and conversion 
Lhfcjxtiur Lu a uLaracLer- coded text stx-ing , The text sti'ing 
is then transmitted to the computer uvv (step 4U4) , in 

which the signal -proceBsing unit 210 in this embodiment 
continually matches the received text strings to the con- 
tents of a database (step 405) . in case of correspon- 
riRnr.R, thR si gna i -process ing unit 210 generates a com- 
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mand, rnrrftsponding to tne text string, to the computer 
200 {Gtcp 40€) , and otheirwice, the text ±B inputted, if 
poyfa'ibltt, to an application in tlie computeir 200 (step 
4{)7) . in nhifs case, an auromatic change becween the scan- 
ner function mode and the control function mode thus 
Lrikfcjto- pl<a.sje (sLep 405) by means of an intelligent filter. 
The intelligent: tilter in rne signal -processing unit 210 
analyses the foarmat of the received text string for iden- 
tification of control inf oarmation. An e-mail address can, 
for example, be identified by nhe presence of an at sign, 
optionally in combination with its relationship with 
othex- given characters, and is interpreted as a command 
to open an e-mail program wich rhe e-mail address enrered 
in the address field. A web address can bs identified by 
the presence of the character combination "http;//" or 
"WWW" , optionally in comblnaclon wlrh ira relarlonshlp 
with othR-r givftn r.ha-ranteri=i , and i ^ i nte.rpretf^.ri a 
command to open a web reader with the indicated address, 
A file address can, lor exatuple/ be IdenLlIled on the 
"h^iajqi jq of the ohaTsntRT nnmbi nst i nn ":\" in nombi n?3t i on 
with a given finalising file type indicator {".doc", 
".e^fci", "-mjj3", etc.) diid liiLtzSipieLtsd ria a cuuuuaiid to 
open a file by means of the program indicated by the tile 
type indicator . 

Accoi-ding to an alternative, the input unit 3 00 is 
actively controllea ro the control function mode by the 
i35=ie.r, hnwp.ve.r, without: uKing hTithons. The. nnmrnsnd indir.fl- 
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t-.ion.c? in hhe. nommancl tield 120 o± tne mouse pad 100 in 
Fig, 1 can be written in a given manner, bo that the pro- 
cfcdtJtiujL 2 0 can detect that the inputted chaaracter-s ax-e not 
r.h;5rar.r.e.rs nhan are no be inpucred into the computer 
according to the scanner function mode, but characters 
LUciL £*epi*es=ieiiL a uuuuuaud and are to be sent to the 
signal -processing unit; '-:;iu ro be processed as such- The 
command indications can be, for example, written in a 
special size, a special font or a special line thickness ► 

AS another exarnple, the change to the scanner func- 
tion mode can be carried out on the basis o£ change com- 
mands which are written in the command field 120 of the 
mouse pad 100, as is evident from Fig, 1, When the useri 
for instance, wants to change to the scanner function 
mode he records by means of the input imit 3 00 the word 
^'scanner" from the command field 120. The processor 20 
identifies this as predetermined information which indi- 
cates that it is now to carry out a scanxier function. 
corresponcLinqly, recordinq of the word "camera" from the 
command field 12 0 results in a change to the photograph- 
ing mode , 

The above description has been qiven with reference 
to a mouse pari and a compute^.r . However, 1 1 wi ! ! he appTFf- 
ciatcd that the arro-ngcmcnt ±o aloo uoablc in other 
cases, such as for controlling a mobile phone or a PDA. 
For instance, the input unit can be used to read, from 
a b^isjness card, a fav rmmbf^r, a phn-n«= mimbe-r, an e-mail 
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address or a web Ei66-rf=>F,F. ?^-nri, on the. basis tJaereof , cause 
the mobile phone or the PDA to connect to one of these 
addresses, in rhis conLej^L, IL will appreciated that the 
input unit and the si gnp? 'I -p-rnr.p.ff si ng nnic can be an inte- 
grated part of the mobile phone or the PDA. 

Reveminq t:o the mouae pcul in Fly, 1, it was stated 
aboire-- t-.hat the pattern on tiie same is an irregular pat- 
tern and that the mounc fianction ie achieved by determi- 
natioa o£ the xel<stLive positions of the i-ecorded images. 
Tn a-nothRT P.mbnrii me.nt ^ the pattern on the mouse pad 100 
can be a pocition-coding pattern, which systematically 
codes positiujiw uver Lhe whole of the mouse pad 100, In 
this case the mouse function can be based on reading off 

pooitiona ucing the pocition-coding pattern* In addition 
the change to tlie mouse function mode can be based on 
recognition ot the position-coding paccern, in addiT:ion 
particular positions or position areas (also called 
doLitciiiifc; (jx i eg ions) , for example those corx-eeponding to 
the different command indicarions in the command field 
12 0, can be dedicated to particular function modes. When 
the processor detects a particular position, it deter- 
mines Which function corresponds to this position. In 
this way the input unit 3 00 can be caused to change from 
one function mode to another- function mode by placing it 
in a particular position on tiie mouae pad, DifXerent 
TRgioriR nf tViR pof^i ti on -cod i ng pattern can aiso be dedi- 
cated to commands for controlling the computer 200, 
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Tnpit-.ead at the signal -processing unic in rhe computer 200 
detecting predetermined information in the text which is 
cnLeredy it can thus detect positions in the form of 
coordinates and identify which command is to be created 
to control the computer 200, For ex:ample, if the user 
wduLtD Lu open the e-mail program in the computer 200/ 
he can place the input unit 300 on the mouse pad loo in 
a position where it says "e-mail". The optical sensor 8 
records an image of the position coding pattern in thio 
position. The processor 20 identifies which position, 
that is which coordinates, correspondR t.n thp. pnfiiti on- 
coding pattern in the image. It sends the coordinates to 
the signal -processlnq unit 210 in the computer 200, The 

signal-processinrj unit 210 identifies thst thRRf^ nnrrrdi - 
nates mean that it io to create a command to the computer 
2 00 which causes it to open the e-iuall pruyrtim, In Lhiw 
case, t.hi=> mRRKagft "Pi-m;gi !" is only an indication to the 
user to which command the field corrcoponda while the 
actual cperaLlojc: Lriyy taxed by Lhe input unit 300 is 
dRt-.RTTTii TiRci by the pofii t.n on-coding pattern. The advantage 
of this arrangement is that the input unit need not sub- 
ject ci Le^L Lo chrixacLex xeuuyiiiLlon (OCR) , with the 
ensuing risk. o± misinterpretation. 

The mouce pad can thue be divided into position 
areas or regions whicli are associated with different 
fiinctions or commands. An addinlonal example of this 
iR that nnR region nan be rieciicated to a relative mouse 
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fuTLOtion mode (t-.h^ nursor is moved m the same way as tlie 
input unit) and anotlncx region to an absolute mouse func- 
tion mode (rhe cux-yor ia placed in the position which 
corresponds to the pnaitinn of r.he input unit on the 
mouse pad) , The input unit itself understands which 
Euncrion it: is to u^e on Lhts basis of whether the posi- 
tion-ending pattern (and hence rhe identiried coordi- 
nates) bclongc to one or the other region . 

OI (juuitie, altex-n&tively the same surface can be 
used foT thR ■r£=ilative and the absolute funcTiion mode and 
the change can be carried out by means of change commcinaB 
ill the wtfiy described above . 

A further example is that rhe mouse pad can have 
an area which ±m dedicated to a scrollinQ fi-inction. The 
input unit can thus be a mouse with various mouse func 
tlons- It can also be a mouse which, in addition ro con- 
trolling a cursor on a display, can confrol ntViRT fTinr.- 
tions of a computer or other electronic dcviccC/ S3uch aa 
a mobile telephone or a PDA. 

The above description is just one ev^3mplf= nf how the. 
arrangement according to the invention can be dccigned. 
based on the summary of the invention, expends in the 
field can achieve a -numbR-r nf variants ot this example 
within the scope of the appended claimc. 
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